Simulating nonequilibrium quantum fields with stochastic quantization techniques 
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We present lattice simulations of nonequilibrium quantum fields in Minkowskian space-time. 
Starting from a non-thermal initial state, the real-time quantum ensemble in 3+1 dimensions is 
constructed by a stochastic process in an additional (5th) "Langevin-time" . For the example of 
a self-interacting scalar field we show how to resolve apparent unstable Langevin dynamics, and 
compare our quantum results with those obtained in classical field theory. Such a direct simu- 
lation method is crucial for our understanding of collision experiments of heavy nuclei or other 
nonequilibrium phenomena in strongly coupled quantum many-body systems. 
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Nonequilibrium quantum field theory is the tool to un- 
derstand a large variety of topical phenomena in high- 
energy particle physics, cosmology as well as condensed 
matter physics. Current and future collision experiments 
of heavy nuclei involve far-from-equilibrium dynamics for 
strongly interacting matter described by quantum chro- 
modynamics (QCD). Other experiments, which have at- 
tracted much interest recently, concern the dynamics of 
ultra-cold quantum gases. Though these involve length 
scales many orders of magnitude larger than QCD, they 
require similar quantum field theoretical techniques. 

For out-of-equilibrium calculations standard approx- 
imation techniques, such as perturbation theory, are 
not uniform in time and fail to describe thermalization. 
There has been substantial progress in our analytical 
understanding of nonequilibrium quantum fields using 
n-particle irreducible functional integral techniques 
However, nonequilibrium truncations are difficult to test 
for crucial questions of QCD or near a Feshbach res- 
onance in atomic media, i.e. where strong interactions 
play an important role. Direct simulations on a space- 
time lattice could boost our knowledge and trigger the 
development of further approximate analytical tools. 

Despite the importance of non-perturbative lattice 
simulation techniques in out-of-cquilibrium quantum 
field theory, these have not been developed so far. This is 
in sharp contrast to well-established thermal equilibrium 
methods Q. Equilibrium calculations can typically be 
based on a Euclidean formulation, where the time vari- 
able is analytically continued to imaginary values. By 
this the quantum theory is mapped onto a statistical 
mechanics problem, which can be simulated by impor- 
tance sampling techniques. Nonequilibrium problems, 
however, are not amenable to a Euclidean formulation. 
Moreover, for real times standard importance sampling is 
not possible because of a non-positive definite probability 
measure. Efforts to circumvent this problem include con- 
sidering the computer-time evolution in Euclidean lattice 
simulations [3J, |j] . A problem in this case is to calibrate 
the computer time independently of the algorithm. 



In this Letter we present a nonequilibrium quantum 
field theory simulation in Minkowskian space time. The 
quantum ensemble is constructed by a stochastic process 
in an additional "Langevin-time" using the reformula- 
tion of stochastic quantization 0,0 for the Minkowskian 
path integral 0, |3] : The quantum fields are defined on 
a 3+1 dimensional physical space-time lattice, while the 
updating procedure employs a Langevin equation with a 
complex driving force in a 5th, unphysical "time" direc- 
tion. Nonequilibrium dynamics is implemented by spec- 
ifying an initial state or density matrix, which deviates 
from thermal equilibrium. For the example of a relativis- 
tic scalar field theory with quartic self-interaction, we 
compute the time evolution of correlation functions and 
consider the characteristic damping rates. 

Though more or less formal proofs of equivalence of 
the stochastic approach and the path integral formulation 
have been given for Minkowski space-time, not much is 
known about the general convergence properties and its 
reliability beyond free-field theory or simple examples in 
equilibrium 8]. Much more advanced applications con- 
cern simulations in Euclidean space-time with non-real 
actions @, |HJ , where standard Monte Carlo methods do 
not work. Despite successful examples, major reported 
problems concern unstable dynamics and incidences of 
apparent convergence to unphysical results [fll fici fTll fl^ | . 

To our knowledge the approach has not been used 
to simulate nonequilibrium quantum field theory before, 
though some properties seem to make it quite suitable 
for that. Firstly, nonequilibrium requires specification of 
an initial state or density matrix. Therefore, the initial 
configuration is fixed which seems to stabilize the pro- 
cedure. Moreover, the additional averaging over an ini- 
tial density matrix can help to achieve fast convergence. 
Secondly, one typically has a good guess for the 3 + 1 
dimensional starting configurations of the Langevin up- 
dating procedure: In contrast to the quantum theory, the 
corresponding classical statistical field theory can be sim- 
ulated using numerical integration and Monte Carlo tech- 
niques 0. Using the nonequilibrium classical statistical 
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solution as the starting configuration can improve con- 
vergence. It also provides a crucial check of the quantum 
result in some limiting cases: For sufficiently large macro- 
scopic field or occupation numbers classical dynamics can 
provide a good approximation 0]. 

For our example we observe good convergence proper- 
ties of the quantum simulations, which is a remarkable 
result. For given initial field configurations at time t = 0, 
very different starting configurations for the 3+1 dimen- 
sional space-time lattice converge to the same nonequi- 
librium dynamics for all t > 0. To obtain this we had to 
resolve the problem of possible unstable dynamics for the 
updating procedure, as is described in detail below. We 
compare our quantum results with those obtained for the 
corresponding classical theory for same initial conditions 
and lattice regularization. We indeed find agreement in 
those cases where this is expected, and observe increas- 
ing deviations for smaller fields or occupation numbers. 
In the following we describe the relevant theoretical in- 
gredients and present the numerical evidence. 

Nonequilibrium quantum field theory can be described 
by the generating functional for correlation functions Q : 



Z[J;p] = Tr jpTee 1 ^)*^)} 
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The path integral JQ) displays the quantum fluctuations 
for a theory with Lagrangian L, and the statistical fluc- 
tuations encoded in the weighted average with the initial- 
time density matrix p(ipi,(p2). Here Tc denotes con- 
tour time ordering along a closed path C starting at 
t = x° = with J c = J c dx° J d d x (usual time ordering 
along the forward piece C + , and anti-temporal ordering 
on the backward piece C~). The initial fields are fixed 
by v?i(x) = ip(0 + ,x) and <fi2(x-) — y(0 - ,x). Nonequi- 
librium correlation functions, i.e. expectation values of 
Heisenberg field operators $(x), are obtained by func- 
tional differentiation. The two-point function, e.g., is 



Tr{pT*(x)$(y)} = 



6 2 Z[J;p] 



j=o 



(2) 



iSJ(x)iSJ(y) 

with all time arguments on C + such that Tc corresponds 
to standard time ordering T. In the following we con- 
sider physical correlation functions, which have their ar- 
guments on C + . The role of C~ is then only to normalize 
Z[J = 0;p] = 1 with Trp = 1. 

Complex Langevin: The complex exponential weight in 
||TJ requires a simulation technique, which is not based 
on a probability interpretation. Stochastic quantiza- 
tion reformulated for real times can provide such 
an approach. The stochastic process is described by a 
Langevin-type equation, which for a real quantum field 
theory governs a complex field <fi = 4>R + i<t>i- The ap- 
pearance of an imaginary part reflects the fact that in the 




FIG. 1: ReC(t) vs t for a free field theory with mass m = 
2.315. The Langevin evolution, shown for $ = 0-9 in units of 
a 2 , converges to the correct result with period 



quantum theory the field picks up a phase by evolving in 
time. In addition to the space-time variable x the field 
depends on the Langevin-time parameter # with El 



dcj>(x- g) 
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8ip(x) 
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ry(x;i?). 
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Here 8S/8ip\ v ^,$ = —0<f> — m 2 (j) — \<fi 3 for a scalar the- 
ory with mass m and self-interaction A. In general 
the real and imaginary part of the Gaussian noise term 
r] = r/Ti + ir/i can be both non- vanishing ||, and the dif- 
ferent choices may be used for optimizing convergence. 
We consider i]i = 0, with (rj(x; l ff)) v = and 



(r](x; 0)77(1'; 0'))r, = 25(x - x')5(4 - ■&') 



(4) 



where (. . .) J; indicates average over the noise. 

The stochastic process (0 is associated to a distribu- 
tion P{(j)R,(j)i)'ff) and averages of observables A{4>) are 
given as area integrals in the complex field plane: 



f]#g] [dfa]A(cf> R + ifa)P(4> R , fa; d) 

/[dfo][dfc]P(ta,&;0) 
/[dfo]A(fa)P eff (fa;fl) 
/[dfo]P off (<fo;0) 



(5) 



Here P c s{<j>R.]-&) = f[d</>i]P(<l>R - i</>j,</>j;i?), where the 
shift in the integration variable 4> R — > 4> R — i(f>i for the 
second equality in JSJ is assumed to hold. The complex 
pseudo-distribution P c s{4>r] 1?) is indeed governed by the 
analytic continuation of the Fokker-Planck equation to 
real times, which admits the stationary solution Q 



lim Poff(fo;tf) = P c ff[0fi] 



,iS[<t>R] 



(6) 



Thus the approach can in principle be used for a 
Minkowskian theory such as Q, with "ensemble" aver- 
ages calculated as averages along Langevin trajectories. 

Numerical simulation: We consider N^N t lattices with 
anisotropic space-time discretization a and at ■ Because of 
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FIG. 2: KeG(t) vs t for the interacting theory with A = 1. As 
starting configuration (i9 = 0) the classical result is taken, and 
the Langevin updating incorporates quantum corrections. 
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FIG. 3: Same nonequilibrium initial condition as in Fig. El but 
null starting configuration for the Langevin updating. Com- 
parison demonstrates the start independence of the result. 



the Courant condition, stable dynamics requires a/a t = 
7 > Vd. The Lan gevin-time discretization is 5$. In 
terms of lattice variables <f> = acf>, rh = am, x = x/a, t = 
t/at, 3 = d/a 2 , e = Sd/a 2 , fj — y/a 3 a t 6i9r) — y/e/ja 3 r], 

{f){x^)fj{x',3')) r} = 28^5^ l (7) 

the discretized equation J2| in Ito calculus reads 

4>(x; d + e) = 4>(x; d) + y/Pyfj(x; i?) 

-i e (n 7 0(i; i?) + m 2 0(i; 3) + \(f>(x; i9) 3 ) . (8) 

Here D 7 is the (anisotropic) lattice d'Alembertian (l4|: 

n 7 cj>(x ) = 7 2 (j>(x + e ) + 0(x - e ) - c t 0(z)) 
-^](0(x + e l ) + 0(i-e l )-20(x)) (9) 

i 

with q = 2 for 1 < £ < N t — 1 and Cjv t -i = 1 for 
free large-i boundary conditions (no coupling to t = Nt). 
In this case we consider <f>{t = l,x) = <j)(t = 2,x) = 
^ciass(i = to set the initial conditions. Below we 

will also use CAr t _i = 2 for fixed large-i b.c. in the case 
of a non-interacting field for comparison, and we set 
4>(t = l,x) — 1 and cf)(t = AT t ,x) = 0. The classical 
field configurations c i ass (t, x) have been obtained by nu- 
merically solving the classical field equations and sam- 
pling over initial conditions, with nonzero field average 
and Gaussian fluctuations [lj. Spatial p. b.c. are used. 

Here we speak of "initial" configuration referring to 
the physical time, and of "starting" configuration for the 
Langevin process. As starting configurations the classical 
solution, i.e. </>(t > l,x;$ = Q) = c iass(£ > l,x), or the 
"null" configuration <f>(t > 1, x; -d — 0) = are employed. 
The figures are for a 8 3 20 lattice with 7 = 4 based on 
10 6 updatings with e = 10 -5 (~ 2 hours vector processor 
time). Error bars are statistical and only indicative. 



In the following we present results for the two-point 
function J5J). In Fig.^ the correlator 

^XpE^^^)) ( 10 ) 

s X 

for a free field of mass rh = 2.315 is shown for fixed b.c. 
with zero momentum initial configuration. (...) denotes 
average along the Langevin trajectories |15j . Shown are 
snapshots of ReC(i) for Langevin-time parameter d — 
0-9, with null start configuration. The evolution in i9 
exhibits slowly damped oscillations 16], converging to 
the free-field result with the correct i-period of 2Trj/rh. 

The unequal-time correlator (|10|l measures the corre- 
lation of the field at time t with the initial field. It gives 
important information about the characteristic time scale 
for the loss of details about the initial conditions. In 
contrast to the free-field behavior, the interacting theory 
has a finite characteristic damping time. This is demon- 
strated in Fig. |21 which shows the connected part 

G (*) = - <^3 E *)> (^3 E M *')> (11) 

s x s x' 

for A = 1 and rh = 0. In Fig. [21a different starting config- 
uration is considered for same c iass(l, x ) initial condition 
as in Fig. [21 The same data is presented as a function of 
the Langevin-time $ in Fig.^Jto see the convergence. For 
these parameters one expects moderate quantum effects. 
In runs with larger coupling or smaller field we find that 
the Langevin updating incorporates increasing quantum 
corrections. Accordingly, one observes larger deviations 
compared to the classical starting configuration. 

In these simulations with e = 10 -5 we encounter in- 
cidences of unstable Langevin dynamics (see also ^3). 
Their appearance depends on the random number and 
they are strongly suppressed by using a smaller step size, 
which indicates that they are artefacts of the discretiza- 
tion. To cope with them we used two methods: 1) back- 
stepping on the trajectory some thousands steps (about 
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FIG. 4: ReG(f) vs i9/a 2 at f = 3 (squares), 6(circles) and 10 
(diamonds), for classical (open symbols) and null (full sym- 
bols) starting configurations. Initial conditions as in Fig. 0] 



0.1 in i?) and restart with a new random number, and 
2) regularizing the process by a small imaginary mass 
(about 10~ 4 /a) in the action. Both methods worked 
quite well. In Fig. 3 triangles indicate the back steppings 
with regularization for the null start. For e = 10~ 6 we 
practically could eliminate the runaway trajectories on 
runs of the same i? length (but ten fold computer time). 

Two procedures can be employed for further tests, 
which are beyond the scope of this letter. Firstly, one can 
compare to analytical approximations based on higher 
n-particle irreducible effective actions Q. Secondly, go- 
ing to sufficiently late times one can compare to certain 
thermal equilibrium results from Euclidean simulations. 

The numerics can be optimized by using improved 
space-time derivatives and Langevin algorithms. A more 
systematic study of the convergence problems and of 
the associated "Fokker-Planck" equation also has to be 
done. This also includes volume, lattice discretization 
and step size dependence which lead to systematic ef- 

fects iB II is minis 

We have demonstrated the possibility of first-principles 
simulations in nonequilibrium quantum field dynamics. 
The range of potential applications is enormous. It may 
be used for out-of-equilibrium as well as Minkowskian 
equilibrium properties extracted at late times. The scalar 
theory considered here extended to two components is 
already relevant for the dynamics of Bose condensates. 
Possible applications to QCD require implementation in 
a non-Abelian gauge theory, which is work in progress. 
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